Multimedia search system

ABSTRACT

A database search system that retrieves multimedia information in a flexible, user friendly system. The search system uses a multimedia database consisting of text, picture, audio and animated data. That database is searched through multiple graphical and textual entry paths. Those entry paths include an idea search, a title finder search, a topic tree search, a picture explorer search, a history timeline search, a world atlas search, a researcher&#39;s assistant search, and a feature articles search.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No.10/103,814, filed Mar. 25, 2002, which is a continuation of U.S.application Ser. No. 08/202,985, filed Feb. 28, 1994, now U.S. Pat. No.6,546,399, issued Apr. 8, 2003, which is a continuation of applicationSer. No. 08/113,955, filed Aug. 31, 1993, now abandoned, which is acontinuation of U.S. application Ser. No. 07/426,917, filed Oct. 26,1989, now U.S. Pat. No. 5,241,671, the disclosures of which areincorporated herein by reference in their entireties.

BACKGROUND OF THE INVENTION

This invention relates to a computer search system for retrievingtextual and graphical information through multiple textual and graphicalentry paths into a database.

Recently, there has been a rapidly growing interest in using CD-ROMtechnology as a dynamically interactive way of presenting materialcontained in books, encyclopaedias, magazines, catalogs, etc. CD-ROMSoffer a set of characteristics that are unique for this purpose. First,they have a very high information storage density (approximately 50times magnetic material), rapid random access of addressableinformation, low cost mass produced copies, and relatively low costplayback equipment. Second, by interfacing a CD-ROM player and CRTmonitor to a computer, stored audio/visual data can be accessedinteractively in a variety of user friendly ways.

Yet with this explosion in storage capacity and quality, there arises aneed for software that readily and easily accesses this full spectra ofdata in a user friendly manner. Despite the great potential forinteractive CD-ROM systems, however, many of the current commerciallyavailable versions have important limitations in meeting this need.These limitations include products lacking entry paths into the CD-ROMdatabase to retrieve graphical information, products that cannotflexibly search and retrieve different types of data formats, orproducts that will not allow the combination of search strategies touncover graphical and related textual information or visa versa. Otherlimitations exhibited by some software products include the lack ofinteractive search tools adapted for non-expert users, and the lack ofinteractive search tool that fully explore and exploit the fullcapabilities of a CD-ROM database.

An example of some of the above limitations is demonstrated by theGrolier CD-ROM based encyclopaedia. The Grolier product provides aninteractive search tool that allows for the access of textual datathrough four search modes. The first search mode involves a Browsecapability where the user types in the first few letters or words of aparticular topic and the software then displays a menu listing thearticle titles that are closest in the alphabet to the search terms. Theuser can then scan forward or backward through the alphabeticallyarranged titles until an article of interest is found.

The second search mode is known as the Browse Word Index. In this mode,the user selects the word occurring in any of the articles in thedisplay. The software then sorts entries in descending order of thewords, based upon the number of times that the specific search wordoccurs in the text. A third search mode involves expanding the BrowseWord Index Mode to combine Boolean operators such as “and”, “or”, or“not”, and the fourth search mode involves linking terms appearing inthe articles that are designated by capital letters. In particular, bydepressing the RETURN key while the cursor is located on the linkingword, the search software will retrieve a menu of article titlescentered on that linked term.

However, the Grolier system only accesses textual data by means oftext-based entry paths. No facility exists for taking advantage of theCD-ROM's capacity to store pictures, sound, or video information.

This shortcoming of a full text/graphics interactive search system isnot overcome by those products that are directed to searching graphicaldatabases. That is because the graphics oriented systems fail to eitherinclude any text-based entry paths or text entry paths that would enablethe user to employ the full capacity of the CD-ROM.

For example, The World GeoGraph computer program provides a graphicsbased atlas exploration program where a user can search through multiplelayers (each layer having a greater degree of detail) of an on-screenmap. The GeoGraph database is also integrated with information relatingto each country of the atlas and the search program includes a featurefor using plain English selection rules contained in dialogs to searchand sort information pertaining to the maps. The World GeoGraph program,however, pertains to a textual search of only that textual informationthat explains the graphical database and the text information isretrieved only by means of a single entry path. World GeoGraph therebydoes not appear to provide full textual search capabilities of an entiretextual database that is distinct from the graphical database.

SUMMARY AND OBJECTS OF THE INVENTION

In view of the foregoing, it should be apparent that a need still existsfor a database search system that retrieves multimedia information in aflexible, user friendly system. It is, therefore, a primary object ofthe invention to provide a search system in which a multimedia databaseconsisting of text, picture, audio and animated data is searched throughmultiple graphical and textual entry paths.

It is a further object of the invention to provide for a search systemwherein both the textual and graphical entry paths are interactive.

It is yet an additional object of the invention to provide for a searchsystem where the textual and graphical entry paths are interrelated suchthat textual information is fully accessible from the graphical entrypaths and graphical information is fully accessible from the textualentry paths.

It is still an additional object of the invention to provide for asearch system where the graphical and textual information are containedin a single database and the information consists of words, phrases,numbers, letters, maps, charts, pictures, moving images, animations andaudio information.

It is yet an additional object of the invention to provide for a searchsystem which is stored on a CD-ROM disc.

It is yet a further object of the invention to provide for a searchsystem which is adapted to operate on a micro-computer in either astand-alone capacity or on a network.

It is still a further object of the invention to provide for a searchsystem where one of the graphical entry paths involves interactivelynarrowing a search of graphical images to a point in which relatedtextual information about each image becomes accessible.

It is still an additional object of the invention to provide for asearch system wherein the textual search can be narrowed to a pointwhere graphical information related to the uncovered text is accessible.

It is a further object of the invention to provide for a search systemwhere both textual and graphical entry paths include functions whichenhance the efficacy of the searches and the accessibility ofinformation retrieved from those searches.

It is also an object of the invention to provide for a search system inwhich an idea search entry path is provided which can retrieve textualinformation stored in stem indexes in the database.

It is yet a further object of the invention to provide for a searchsystem that compares misspelled search terms with definitions stored ina database dictionary. The search system then automatically suggestsalternative spellings to the user.

It is an additional object of the invention to provide for a new listfunction if the initial information uncovered by the search does notmeet the user's expectation. The system will then suggest alternativeterms for ambiguous search terms.

It is a further object of the invention to provide for a search systemwhere phrases, paragraphs or sentences can be entered by the user to besearched. The entered search terms are then compared to a list of stopwords, and those stop words are then automatically eliminated, such thata search is performed only on particular terms occurring in the phrases,sentences or paragraphs.

It is still a further object of the invention to provide for a searchsystem whereby phrases can be searched together rather than being brokenup as a group of individual searches for key terms.

It is yet an additional object of the invention to provide for a systemwhereby the graphical and textual information comprise an encyclopaedia.The textual information of the database also includes a dictionary, athesaurus, a glossary and a stored fact index.

It is still another object of the invention to provide for a searchsystem where one of the textual entry paths consists of a title findersearch.

It is a further object of the invention to provide for a search systemwhere one of the textual entry paths consists of a topic tree programthat divides all textual information into topics, sub-topics and so on,in order to assist a user in finding an article of interest.

It is yet a further object of the invention to provide for a pictureexplorer entry path which enables a user to find pictures and thenretrieve related textual information for each picture.

It is yet a further object of the invention to provide for a searchsystem where one of the textual entry paths consists of a historytimeline search program.

It is an additional object of the invention to provide for a searchsystem wherein a portion of the graphical and textual entry pathsconsist of a world atlas entry path.

It is still a further object of the invention to provide for a textualentry path which highlights particular feature articles. This entry pathtakes a user directly to one of a plurality of articles located in thesearch system.

It is also an object of the invention to provide for a search systemwhere one of the textual entry paths consists of a researcher'sassistant program.

Briefly described, these and other objects of the invention areaccomplished by providing a search system for retrieving informationcomprising multiple textual entry paths for searching textualinformation and multiple graphical entry paths for searching graphicalinformation such that the search system retrieves information throughboth the textual and graphical entry paths.

The textual and graphical entry paths are made up of eight separate andinterrelated entry paths such that textual information is fullyaccessible from the graphical entry paths and graphical information isfully accessible from the textual entry paths. A first textual entrypath consists of the Idea Search entry path which retrieves textualinformation stored in the stem indexes in the database. Each stem isidentified with a root and stems are linked to each root so that theyrepresent all related endings for that root. Each stem is related tounits of textual information in the database. Stem terms are thenconcatenated by the Idea Search in order to map the stems to the sameidea. The concatenation step involves linking the stems together basedon grammatical linkages and based on thesaurus linkages. Informationretrieved from the Idea Search is then ranked based upon twocoefficients: exhaustivity and exclusivity. Exhaustivity measures thenumber of occurrences for that stem in the database. The exclusivitycoefficient measures the degree to which that stem is related to theidea. The exclusivity and exhaustivity coefficients are then calculated,combined with other stems and calculated for each article. A list ofarticles is then ranked based upon the coefficients in order ofrelevance to the search terms.

Another textual entry path consists of a title finder search. The titlefinder assists the user in uncovering articles stored in the searchsystem. Those article titles are uncovered either by moving through analphabetical list of article titles until a desired title is located,clicking a letter tab for the first letter of the subject so that a listof article titles having the first letter is provided, or typing in thearticle title name such that the page listing the article title is thendisplayed.

One of the graphical entry paths consists of the picture explorer whichenables the user to find pictures and then retrieve related textualinformation for the picture. In operation, the picture explorer isprovided in three modes: a picture tour mode where pictures arepresented in random order, a picture finder mode which allows the userto select from a list of alphabetically ordered pictured captions, or apicture search mode where the user searches picture captions by enteringsearch terms and having the computer search those entered search terms.A further textual entry path consists of a history timeline program. Thetimeline displays events on a graphical timeline in order that a usermay select an event and retrieve further information about that event.The timeline is divided into a year interval bar, major event boxes, anda president's bar. Any one of the elements on the bars are activated bya user in order to retrieve related textual information.

A further entry path which is graphically and textually based is theworld atlas entry path. This program enables the user to search maps ofan atlas. The atlas can be searched by having the user either identify aplace name, or by scanning, or rotating the atlas. If the place namesearch is implemented, the program draws a corresponding map around thespecified place. The atlas can then be viewed at multiple levels ofincreasing detail for any part of the atlas. Textual information relatedto any place labeled on the atlas is then retrieved.

A further entry path consists of the researcher's assistant program. Theresearcher's assistant contains subject matter categories divided intotopics and the topics are then divided into assignments. Each assignmentis then ranked by its level of difficulty.

Finally, the invention includes a textual entry path which highlightsparticular feature articles. This entry path is designed to take theuser directly to one of a plurality of articles located in the database.

With these and other objects, advantages and features of the inventionthat may become hereinafter apparent, the nature of the invention may bemore clearly understood by reference to the following detaileddescription of the invention, the appended claims and to the severaldrawings attached herein.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a functional flow chart showing the logical operations of theMain Menu program of the present invention;

FIG. 2 is a flow chart of the logic operations of the Idea Search entrypath of the present invention;

FIG. 3 is a first flow chart of the logic operations of the Idea Searchentry path;

FIG. 4 is a second flow chart of the logic operations of the Idea Searchentry path;

FIG. 5 is a third flow chart of the logic operations of the Idea Searchentry path;

FIG. 6 is a first flow chart of the logic operations of the ArticleDisplay program;

FIG. 7 is a second flow chart of the logic operations of the ArticleDisplay program;

FIG. 8 is a flow chart of the logic operations of the Tools function;

FIG. 9 is a flow chart of the logic operations of the Notebook function;

FIG. 10 is a flow chart of the logic operations of the Research Pathfunction;

FIG. 11 is a flow chart of the logic operations of the Last Screenfunction;

FIG. 12 is a flow chart of the logic operations of the Back function;

FIG. 13 is a flow chart of the logic operations of the Title Searchentry path;

FIG. 14 is a flow chart of the logic operations of the Topic Tree entrypath;

FIG. 15 is a flow chart of the logic operations of the Picture Explorerentry path;

FIG. 16 is a first flow chart of the logic operations of the HistoryTimeline entry path;

FIG. 17 is a second flow chart of the logic operations of the HistoryTimeline entry path;

FIG. 18 is a first flow chart of the logical functions of the WorldAtlas entry path;

FIG. 19 is a second flow chart of the World Atlas entry path;

FIG. 20 is a flow chart of the logical operations of the Place Namesubroutine for the World Atlas entry path of FIG. 18;

FIG. 21 is a flow chart of the logical operations of the Researcher'sAssistant entry path;

FIG. 22 is a functional flow chart of the logical operations of theFeature Articles entry path; and

FIG. 23 is a plan view of the search system and related hardware.

DETAILED DESCRIPTION OF THE INVENTION

In the context of this disclosure and the claims appended hereto,references to an information database can apply to any type of data, anytype of data format, or any type of storage medium. A preferredembodiment of this invention involves CD-ROM technology. However, thesystem can also include DVI, CD-I, or any other suitable optical memorydevices. The system is adapted to run on any computer device. As anexample, the system may run on an IBM AT or other 286, 386 or 486 basedcomputer having similar characteristics as a stand-alone unit. In anetwork environment, for example, the preferred embodiment can run on anIBM host and on a Novell communications network. However, any computerhaving sufficient processing speed and memory capability can beemployed.

That system also may include a VGA card and a VGA or multi-sync typemonitor, a 20 MB Hard Disk Drive, a Speech Adaptor and Card and a mousewith related software. Other features for the preferred hardware caninclude a computer with at least 1 MB RAM, a DOS Version 3.3 (or laterrelease) and a CD-ROM drive with a controller card. Compatible CD-ROMdrives include the CD V100 by Sony Corp., or models by Hitachi or AMDEK.Any other compatible CD-ROM drives must use the MS-DOS standards(CCD-ROM extension).

Although the system forming the present invention can be used for anyapplication, a preferred embodiment is as a multimedia encyclopaediadatabase and search system. The database for the preferred embodimentconsists of approximately 8.8 million words, 5,200 articles, 26,023concise capsule articles, 63,503 entries in a Fact-Index, 65,000 entriesin a full database dictionary, 1500 glossary terms, and a thesaurus.

The database also consists of 15,000 graphics comprisingphotographs/charts/diagrams and animations. Those graphics can includelow resolution images, depending on the capabilities of the hardware.Supported graphic standards include VGA (640×480×16 colors) and superVGA images (640×480×256 colors), though standards within or beyond theseare also envisioned for this product. Nothing contained herein precludesthe possibility of releasing this invention on computers which supportdifferent graphics standards. The preferred embodiment includes 60minutes of audio, including 1,500 glossary terms, and other audioselections, and some 45 animation sequences. The amount of audio andanimation is expected to increase depending on the hardware and softwarecapabilities.

Referring to the Figures, wherein like references refer to likeelements, FIG. 1 illustrates a functional flow chart of the logicaloperations of the Main Menu program 10. It is from the Main Menu 10 thata user can enter the multimedia database in order to view articles,pictures, illustrations and other special features including sound andmoving pictures.

There are eight entry paths available from the Main Menu program 10 intothe database. Those paths include the Idea Search 30, the Title Finder40, the Picture Explorer 50, the Topic Tree 60, the Feature Articles 70,the World Atlas 80, the History Timeline 90 and the Researcher'sAssistant 100. Additionally, upon turning on the Main Menu program 10,various functions become available to the user. Those functions includea Notes function 25, a Close command 28 and a Help function (notillustrated). Brief descriptions of each of the entry paths are providedbelow.

The Idea Search entry path 30 assists the user in finding informationregarding any topic for exploration. In this entry path 30, the usertypes in words, questions or descriptions for the search, causing thecomputer to search for any articles related to that search request.

The Title Finder 40 provides the user with an alphabetical list of allarticles in the database. The user can then choose the title of anarticle that he wants to review by either scrolling through a titlelist, typing in a desired title or browsing through the title list afterchoosing a letter tab.

The Picture Explorer entry path 50 allows the user to view pictures thatare stored in the database. The Picture Explorer accesses information inthree modes: (1) by allowing a user to randomly browse through acollection of pictures, (2) by displaying a list of captions andenabling a user to select corresponding pictures or, (3) by allowing auser to enter a description of the picture which then triggers the entrypath to automatically search the terms of that description forcorresponding picture captions.

The Topic Tree entry path 60 provides the user with both a means forbrowsing through a list of topics and sub-topics and also foriteratively refining the topical subject matter. Specifically, TopicTree divides all of the information in the database into lists of topicsand sub-topics so that by browsing through successive lists, the usercan iteratively narrow his search until he finds an article of interest.

The Feature Articles entry path 70 provides a selection of specialinterest or focus articles for the user. The user then picks one of thearticle titles in the menu in order to be taken directly to the article.

The World Atlas entry path 80 draws maps of the earth after interactiveselection by the user. The maps can be enlarged or contracted, rotatedor viewed along longitudinal and latitudinal lines. Moreover, a placefinder function is available which helps the user choose a place on themap. Once that place name is selected, the computer will then draw a maparound the selected location. By then clicking a place label with amouse on the map, an article corresponding to that label can be accessedfrom the database.

The History Timeline entry path 90 enables the user to browse through atimeline containing references to historical events. Choosing any ofthose events will cause the system to provide a summary of the event andthen list articles related to that event, historical person, etc.

The Researcher's Assistant entry path 100 contains a set of researchcategories and sub-topics. Each topic, in turn, includes threeassignments which are classified according to level of difficulty. Theuser may then choose one of those assignments which then refers him tothe Main Menu to complete his research.

The Main Menu 10 also includes several functions. The functions areNotes 24, which allows the user to take notes; the Research Pathfunction 25 which opens a window on the screen displaying a list ofprevious steps that the user has taken in his searches; the Last Screenfunction 26 which backs-up along the research path one step to returnthe user to the last screen he saw; and the Getting Started function 27which provides a step-by-step tutorial that guides the user through themultimedia database. A Close command 28 also is available in order toexit the system.

When turning the system on, the Main Menu display 20 is shown. The usermay then select at step 22 any of the above identified entry paths orfunctions. The selection activates the designated function or entry pathprogram.

Upon exiting from a selected entry path or function, the user can returnto the Main Menu display 20. Upon choosing the Close command 28, theuser exits the system at step 29. The Close command 28 is alwaysavailable as an option in the Main Menu display. Hence, the program canalways be exited at any time the Main Menu display is available.

FIGS. 2–5 illustrate the Idea Search entry path 30. As previously noted,the function of the Idea Search 30 is to aid the user in findinginformation about any topic he wishes to explore in the database. TheIdea Search entry path 30 is based upon a term based search thatresponds to user entered search information. The computer then isolates“legal” search terms and searches through the database. Following thesearch, a list of article titles ordered by relevance to the searchrequest are then provided by the computer.

The Idea Search 30 is entered by clicking a mouse over an associatedicon in the Main Menu display 20 (FIG. 1). A call to the Idea Searchprogram 100 raises the Idea Search entry screen 102. The Idea Searchentry display 102 includes a number of functions located on a promptline at the bottom of the screen. Those functions include Tools 106,Notes 24, Research Path 25, Last Screen 26, New Search 116, Back 118 andMain Menu 120. Some of the functions, as denoted by the letter “B”,return the user directly back to the search display when completed.Others, however, do not. A description of each of the functions will beprovided in more detail below.

After the user has made a selection 104 to enter search terms 112, theuser then types in those terms in a window on the display. The searchterms can be entered as words, phrases, whole sentences or entireparagraphs. The only limitation is that these terms describe the topicor question to be searched. The user then clicks the mouse on the iconfor the Go On command 122 which tells the computer to begin searching.If a search word is misspelled, the computer will then access aninternal dictionary and an internal thesaurus stored in the database ifit does not recognize the misspelled word. A check for misspelling thusoccurs in step 124. If the word is found to be misspelled at step 126,then the Idea Search will display a list of other spellings 128 thatclosely approximate the misspelled word. The user may then use a mouse,for example, to click the proper word on the list which automaticallymakes the correction 130. The user then actuates the Go On command 131which causes the properly spelled word to be returned to the list ofsearch terms at step 132 and the system to execute the search on thecorrectly spelled word. The correctly spelled term will then bedisplayed in a list of the located items 136 following their search atstep 134. Details regarding step 134 are provided in FIGS. 4–5.

Items on the displayed list, for example, can be titles to articlescontaining the search terms. It is contemplated, however, that anyinformation representing the search term can be represented in thislist.

More particularly, in addition to the items of the list, the displayscreen 136 shows search words that have actually been searched. Thosewords are highlighted to set them off from the non-searched terms. TheIdea Search 20 entry path automatically decides which terms to highlightand which terms not to search, based on a review of stop terms stored inthe database. Examples of stop terms include “what”, “the”, “and”, “or”,punctuation, etc. The items listed also are arranged in the display 136in order of relevance to the entered search terms. A further descriptionof the relevance ranking algorithm is provided.

Some of the items listed are preceded by one or more asterisks. Theasterisk(s) indicate that the adjacent item in the list is likely tocontain highly relevant information. In order to choose the item, theuser can then move through the list using Up and Down arrow keys locatedon the display adjacent to the list. When a user sees the article thathe wants, he then clicks that article that is likely to have the bestinformation about the search word.

Referring now to FIG. 3, further details regarding the Idea Search 30are shown. In particular, a screen 136 is presented along with icons forseveral functions located on the prompt bar. The user selects any one ofthe functions by clicking a mouse on an appropriate icon representingthat function. Those functions include Tools 106, Notes 24, ResearchPath 25, Last Screen 26, Back 118 and Main Menu 120. A description foreach function is provided with reference to FIGS. 8–12.

If the user is interested in looking at the items on the list at step140, he can then move through the list of items, as previouslydescribed, and click the mouse on a desired item at step 142. As aresult, the user goes into the (article) program at step 144. If,however, the user does not see an item that he desires, or wishes tosearch for different terms, he branches at step 146 to select the NewSearch mode 148. If the user then decides to pursue a new search hebranches to the beginning of the Idea Search program 150. If, however,the user is only interested in improving his original search request, hethen clicks the icon representing the New List function 155.

The New List function 155 improves the original search request by eitherproviding non-ambiguous alternate search terms 158 or by suggestingalternate search strategies.

The ambiguous term check 158 acts like a thesaurus. For example, shouldthe user type in the word “rain,” alternate search terms for that word(e.g. “rainfall”, “snow”, “storm”, “water”, “weather”) would be listedon the display at step 160. The user may then click the desirednon-ambiguous terms in the list, or enter the non-ambiguous terms in theIdea Search window 162, and then search for non-ambiguous search terms164 (see FIG. 2). Following the ambiguous term search, the program thenautomatically returns the user to a new display list of the locatednon-ambiguous terms 136 (see FIG. 2).

However, if none of the listed non-ambiguous alternate search termspresents a viable alternative, the computer will then display theoriginal search request and will also suggest ways to modify thatrequest at step 166. To modify the search, the user then retypes newsearch words 170, 173 that conform to the alternate strategies. The GoOn command 174 is then activated to generate a new search 175 (see FIG.2).

The ambiguity check feature operates as follows: suppose this searchinvolves different forms of “rainfall” and the user types in the word“rain”. The list generated from the Idea Search might then include alist of articles entitled CLOUD, MISSISSIPPI, TENNESSEE, ENGLAND andKANSAS. Although the search concerned “rain”, the last four articleswere included on the list because those articles contain sections onclimate and weather. To improve upon that search, therefore, the NewList function 154 is selected.

The original request for rain, will then reappear but will not behighlighted. The user can then move the cursor over the “r” in rain andclick the mouse. As a result, non-ambiguous suggestions for the term“rain” will be presented. To improve the search, one suggestion would beto change “rain” to “forms of rain”. Once the mouse is clicked over thissuggestion and then the Go On is clicked, the computer will begin asearch for new articles which may relate more closely to “rainfall”.

FIG. 4 illustrates further details of the Idea Search 30. Moreparticularly, FIG. 4 is an expanded logical flow chart of the ExecuteSearch step 134 shown in FIG. 2. When the terms are entered onto thescreen, as described previously, at step 200, the Idea Search programthen reviews those terms against a list of stop words 202. As previouslydescribed, stop words consist of terms such as “the”, “a”, punctuationand other terms normally deemed non-essential. The existence of the stoplist allows the user to type in entire sentences or paragraphs of searchinformation which will then be reviewed and edited so as to avoidinefficient searches.

If a term appears on the stop list in step 204, then that term isdeleted from the legal search terms actually searched by the computer atstep 206. The computer then determines if all of the search terms havebeen reviewed by the stop list at step 207. If not, it loops back forfurther stop checks at step 208. Once the entire search inquiry isreviewed and all the stop terms removed, then the search terms areappropriately highlighted for subsequent display 210 (see FIG. 2, 136)If a search term is not found in the stop list or in the database, anappropriate message is generated. The non-existent term is also excludedfrom the search inquiry.

The entered search terms are then compared to a phrase list 211. Thepurpose of the phrase list is to avoid inefficient search strategies forterms that have a unique meaning when combined in a phrase. For example,if the user wishes to search the phrase “German Shepherd” a databasesearch of the individual terms would bring up information on the countryGermany, or men who watch flocks of sheep. Articles involving dogs wouldlikely be ranked towards the bottom of the list. However, if the phraseitself were searched, the search may be more efficiently accomplishedand more accurate results provided.

The phrase search is entered only when the software finds a phrase thatmatches phrases stored in an internal phrase list. The phrase searchprogram then inquires; do you want this (display phrase terms) phrasesearched? If the user answers yes, then the system internally links theterms together by placing hyphens between adjacent phrase terms 213.Step 214 involves comparing the linked terms to a phrase list. If theentered phrase is matched to the phrase list 215, then the occurrencesof that phrase are linked to the articles in the database 216. Adiscussion of how articles are linked and listed is provided withreference to FIG. 5. Once the phrase search is complete, the programloops back 218 to step 211 to see if the user wishes to searchadditional phrases; if the user does not 220, then the program skipsdown to step 224.

Although not illustrated, two other search modes are available. Theexpert mode allows users to search literals without having thoseliterals subjected to the stop list or stemming (discussed below). Theexpert mode is actuated when the user surrounds literals by quotationmarks.

Furthermore, the user also can designate priority search terms by typingat least one “+” symbol next to a term. The computer will then rank theterms by priority so that those terms will be weighed in advance of thestructured query. The user can also order multiple priorities by placingmore than one “+” sign.

Step 224 involves the step of building the search inquiry structurethrough stem indexing. The purpose of stem indexing is to provide asearch of not only the entered terms, but all related terms.Accordingly, if the user types in the word “leaf” in the search windowat step 112 (FIG. 2), stem indexing will link all other stems to theroot “leaf” that exist in that index, i.e., “leaves”, “leafing”.Following stem indexing, the stems are linked to a Basic Receiving Unit(“BRU”) 226 in order to map the stem to the idea.

A BRU represents the lowest common denominator for the database. BRU'sare discrete data elements defined by subject matter. Thus, the size ofBRU's may vary depending upon the amount of information for a distinctsubject. In the encyclopaedia embodiment, BRU's represent each of thesubjects listed in the table of contents for an article. Accordingly,when stems are concatenated at step 228 to the BRU, those stems are thuslinked to a subject matter-based data entity. The linked stems for theroot are then concatenated at step 228.

Referring now to FIG. 5, the remaining steps of the Idea Searchalgorithm are described. At steps 230 and 232 the concatenated stems aremeasured using two coefficients. The first coefficient 230 involves themeasure of exhaustivity of the search term. Exhaustivity represents amathematical measure of the number of occurrences of the stem in theBRU's. The exclusivity coefficient 232 involves the relatedness of thesearch term to the idea being searched.

An example of the difference between exhaustivity and exclusivity can beseen when comparing the term “small” to the term “German”. It is highlylikely that “small” would have a high exhaustivity coefficient but lowexclusivity coefficient. “German” would have the opposite result.

Once the coefficients are calculated they are then combined to provide ascore for each BRU at step 234. The BRU's scores are then combined toprovide article scores 235. The article titles are then ranked byrelevance in step 236. As previously noted, one or more asterisks may beappended to article titles in the lists. Asterisks denote articles whosecombined coefficients scores exceed a pre-set threshold 238. The list ofarticle titles is then displayed at step 240 (same as step 136, FIG. 2).

Referring now to FIG. 6 the program for displaying the article is shown.The database of the instant invention, as previously mentioned, isparticularly applicable for use as multimedia encyclopaedia. A largepart of the encyclopaedia database consists of articles which containtext, color photographs, tables, charts and maps as well as audio andanimation data. The instant computer program is thereby designed so thatthe user may easily access the various types of data without losingtrack of his place in the encyclopaedia. Each screen is also set up togive the name of the article that is being viewed and the page numberrelative to that article. Side notes are available in the articles toindicate the focus of particular paragraphs of interest.

The text of the article is comprised of underlined and non-underlinedwords. If the user places the mouse and clicks on any of thenon-underlined words an automatic dictionary definition for that word isdisplayed. Upon clicking it closed, the dictionary window will thendisappear and the user returns to the article. The underlined textdesignates glossary terms. By clicking an underlined word with themouse, a window appears showing the definition of that word. An audiopronunciation of that word also occurs. An audio sound icon is alsodisplayed in the glossary window prompt line. The icon leaves the userwith the option of hearing that word pronounced again.

Accompanying the text are numerous functions represented by icons. Thefunctions include a Picture display function, a More About function, aTake Another Look function, a Moving Picture display function, and anAudio function. Each of the functions will be described in more detailbelow.

The article display program 250 is entered at 252 where the text of thearticle is immediately displayed 254. In addition to the previouslymentioned text and functions represented by the article display program250, a plurality of functions are represented on prompt line 252. Thosefunctions include the Main Menu function 120, Notes 24, Tools 106, Print258, Research Path 25, Last Screen 26, Return to Entry Path 260 and theTable of Contents 262. The user may select any of those functions atselect step 256. Details regarding the operation of the variousfunctions are discussed further in connection with FIGS. 8–12.

Should the user wish to read the article in step 264 he moves the mouseand/or cursor to the Up/Down icons or keys. If in reading the article,the user does not understand a word 266 or wishes to receive a furtherdefinition of that word, he may then click the mouse on the word inquestion in step 268. The definition for that word is then automaticallydisplayed at step 270.

The user may then choose a number of dictionary-related functions instep 272, including Tools 106 and Notes 24. However, should the userdesire to return to the article, he activates the Close command 28.

If the user wishes to obtain a glossary definition for an underlinedword at 274, he clicks the mouse on the underlined term in step 276. Theunderlined term, as previously described, is then displayed and thepronunciation of that term enunciated at step 278. The glossary windowalso provides the user with a variety of functions including Tools 106,Notes 24, and Audio 280. By actuating the Audio function 280, the usercan replay the enunciation of the glossary term. Activating the closecommand 28 returns to the article display 252.

Articles are organized so that by activating an icon showing “a pair ofeyes”, the user calls the Take Another Look function 282. This functionis used to explain a difficult concept through pictures or language thatis simpler than that used in the article text. The prompt line in theTake Another Look function 282 includes the Tools function 106, Notesfunction 24 or the Close command 28.

If a Picture icon (represented by a camera) is shown adjacent to text284, the user may activate an associated picture by clicking the icon onstep 284. The picture is then displayed. Multiple pictures 292 can bereviewed by clicking the mouse on up and down arrow icons 293.

The picture display mode 284 also includes a number of functions tofacilitate a review of the picture. The caption function 288, forexample, provides a window over the picture describing the contents ofthat picture. The user is then presented with several functions formanipulating, the caption. The move caption function 290 moves thecaption to the top of the screen so that the user can see the portion ofthe photograph or picture under the caption. By clicking the movecaption icon again at step 290, the caption is returned to the bottom ofthe window. Activating the Close command 28, closes the window, and theuser can then return by clicking close 28 again 254.

The scan function 291 enables the user to scan up, down, left or right.

Finally, pictures can also be viewed using an up-close function 296.When activated, the system enlarges the picture one or more levels.Activation of the close command 28 will return the user to the articledisplay.

FIG. 7 illustrates additional logical operations of the article displayprogram. In particular, if an associated audio icon exists adjacent totext at step 300, then the user can click the icon, on causing adigitized audio selection to be played at step 302. The user can selectthe audio function 300 as many times as desired.

If the text has an associated video icon 304, then the user can activatea display of a still frame of that video at step 306 by clicking thevideo icon with the mouse. The animation sequence commences byactivation of the Go icon command 310, 311. The Go command can bere-activated again to review the same video. Any time the user wants tostop the animation, he can click the mouse on an associated Stop icon314. Once the animation has been stopped, clicking the Go icon 310causes the animation to start again 311. Moreover, to see the animationin a step by step sequence, the user can employ step options 320 whichallow the animation to move one frame at a time backwards or forwards322. Additionally, the user has the option of repeating the entireanimation. This occurs by clicking the Repeat icon 324. To exit thevideo animation function 324 the user must activate the Go On command328 which returns him to the article display program entry point 252(FIG. 6).

The final function available in the article display program is the SeeAlso or Cross Word function 330. This function is displayed when thereis material related to the article being displayed. If the useractivates an appropriate icon for this function, a list of relatedarticles is displayed only if more than one related article exists.Otherwise the function takes the user directly to the related article332. If the user then finds an article of interest 334, he then callsthat article 335.

Referring now to FIG. 8, a functional flow diagram of the logicalelements of the Tools function 350 is illustrated. The Tools functionincludes five functions: Glossary 360, Bookmark 370, Find-a-Word 380,Dictionary 390 and Cut and Paste 400. In addition, a Close-Tools command395 is available to close the Tool function 350. Brief descriptions ofthe Tools functions are set forth below.

The Glossary function 360 operates in the same manner as described inFIG. 6. The Glossary function 360 operates by first prompting the userat step 362 to click on an underlined word. Once the word has beenclicked, a window then opens at 363 and the word is spoken 364. Byactivating the Close Tools command 395, the window is removed.

The bookmark function 370 marks a specific place in the database so thata user can return to that place at a later point in his research. Whenthe bookmark function 370 is clicked on, if there are no bookmarks, theuser is allowed to type in a bookmark in the database. Otherwise theuser is presented with a menu having two choices 372: (a) add a bookmarkto the section 373 or (2) select a previously-stored bookmark 377. Thefirst option opens a window 364 which requests the user to type in thename of the bookmark. Once that has been done, the user then must pressthe enter key 375 to save the bookmark. Selecting the second optioncauses the bookmark to display a list containing the names of all thebookmarks that have been saved 376. Selection of a desired bookmark 377will cause associated articles to be displayed.

The Find-a-Word function 380 enables the user to look up the nextoccurrence of a word found in the text of an article. The Find-a-Wordfunction 380 operates as follows: the user activates the Find-a-Wordfunction through an appropriate icon. A window 382 is then opened whichinstructs the user to click a word in the text. The computer displaythen jumps to the next page that the user is currently viewing anddisplays that page 384. Each time the subject word appears on that page,it is highlighted.

For example, suppose a user is on page 1 of the ASTRONOMY article andwants to find the next occurrence of the word “sky”. ClickingFind-a-Word 380 and then clicking the word “sky” will take the user topage 3 of the article where he can see the word “sky” highlightedseveral times.

The Dictionary function 390 allows the user to look up the meaning ofany word he does not know or recognize. In operation, when theDictionary function icon 390 is clicked, a window 392 first opens. Thewindow prompts the user to click the word that he wants to look up inthe dictionary. After selecting a word, a dictionary display 394 isopened up. The display provides the button is released, the computerwill then ask whether the user wishes to save that text 404. If the userclicks “yes” 405, then the computer will transfer information into theNotebook 408.

If the Notebook is full, or if the user tries to cut and paste too muchtext 406, then a message will appear on the display 410 instructing theuser to either erase the Notebook or highlight less information. If theuser chooses not to save text 411, then by activating the Close Toolcommand 412, the user returns to the appropriate screen.

Referring now to FIG. 9, the Notes or Notebook function 24 is activatedwhen the user wishes to take notes on information appearing anywhere inthe database. When the icon representing the Notebook function 24 isactivated, a window opens 422 which provides an available space for theuser to enter his notes. As the user enters information in this window,letters will be added in the box where a flashing line on the cursorappears. Text is inserted by moving the cursor to where the user wantsnew text to appear. The notes window 422 also includes up and downarrows for scrolling the text up and down, one line at a time. TheNotebook window 422 is adapted to hold approximately 108 lines of text.If the window 422 becomes full, some information will need to be erasedbefore any new text is added. Text is erased by depressing the BACKSPACEkey.

The Notebook window 422 is accompanied by a variety of functions andcommands. The Close function 424 queries the user whether he wishes tosave his changes that were made in the actual dictionary entries forthat word as it would appear in a published dictionary. An example of adictionary that could be used in such a database is the Merriam WebsterIntermediate Dictionary. To return to the text without using thedictionary again, the Close Tools command 395 is activated.

The Dictionary may be scrolled up or down by clicking a mouse over uparrows on the display (not shown). By clicking the up arrow, thedefinition of the word that precedes the one just viewed can be seenwhile the down arrow takes the user to the next word in the dictionary.If the word definition covers more area than available on the screen,clicking the down arrow then displays the rest of the definition.

The Dictionary function 390 is available any time a mouse or cursor isplaced on a word 392 that does not activate a separate function. Thepurpose of the Dictionary function 390 is, therefore, to remind usersthat this feature is available.

The Cut and Paste function 400 lets the user copy part of an articlethat he is viewing and place that information directly into his Notes(see FIG. 9). When the Cut and Paste function 400 is activated, thecomputer will ask the user to highlight words to cut and paste 402.Highlighting the text involves moving a mouse and/or cursor to thebeginning of the place in the text that the user wishes to underline. Hethen depresses one of the mouse buttons and holds the button down whiledragging the cursor to the end of the text that he wants to cut-out.Words will be highlighted as the mouse moves across that area. When themouse Notebook window 426. If the user enters “yes” 427, then thecontents of the Notebook, along with any changes made in those contents,will be saved. The user is then returned to the screen from which heopened the Notebook. Clicking “yes” 427 also provides a safety function.If the user accidentally clears information in the Notebook, then byclicking “yes” 427 that information will be restored. If the user doesnot want to save any changes, he enters “no” 429 causing all of thechanges made in the Notebook to be erased. As a result, the originalinformation that had been in the Notebook before the changes were madewill be available 430.

The Beginning of File function 435 lets the user move up to the firstline of the Notebook. The End of File function 437 takes the cursor tothe last line of text appearing in the Notebook window.

The Move function 440 moves the Notebook window to the top of thescreen. Activating the function a second time, puts the Notebook windowback at the bottom of the screen. The purpose of the Move function 440,therefore, is to place the window in an appropriate area so that theuser can still see information on the screen.

The Size function 442 changes the size of the Notebook window display.When activated, the size of the Notebook window 422 is doubled. Byclicking the size function 442 again, the Notebook window 422 is reducedto its original size so that more of the underlying text is visible.

The Print function 444 activates printing of the contents of theNotebook window 422.

The Clear function 446 removes all text from the Notebook. When theClear function 446 is clicked on, the computer will ask the user at 448whether he wishes to save his changes. If he answers “yes” 449, then thecontents of the Notebook, along with any changes, are saved at step 450.If the user enters “no” 451, whatever was originally in the Notebook isrestored and the changes are deleted at step 452.

FIG. 10 illustrates a flow chart of the logical operations of theResearch Path function 25. When entering Research Path 25, the userclicks on the research path icon whereupon a display list showing themajor steps that the user has previously taken, is displayed at step470. The major steps listed on the display include the entry pathspreviously taken, the title of the articles that the user has previouslyreviewed and any headings or subheadings of those articles that the userhas seen.

For example, the following list represents a typical research path foran encyclopaedia search:

-   -   Science Feature Articles        -   ASTRONOMY            -   Eclipses        -   ANIMALS, DOMESTICATED    -   Title Finder        -   -   Aardvark

The entry at the top of this list, “Science Features Articles”,represents the first entry path while the article “Aardvark” is the lastplace the user was before his present location. From this list, it alsois clear what research has already been done. The two entry paths,“Science Feature Articles” and “Title Finder”, were accessed and thearticles on “Astronomy”, and “Domesticated Animals” were uncovered. The“Aardvark” and “Eclipses” subjects within the articles were thenspecifically accessed.

Should the user desire to return to a previous spot 472 listed on theResearch Path display 470, the user employs his mouse to click that itemon the list 474 which will then return him to the first page for thatitem 476. If, however, the user does not wish to call any of the itemson the Research Path, then he may select at step 428 the Tools function106, the Dictionary function 390, or exit by turning on the closecommand 28.

FIG. 11 illustrates the Last Screen function 26. This function enablesthe user to take one step back, returning to the last screen. The LastScreen 20 can, for example, be used to retrace steps through a series ofscreens. Thus, if the user is looking at page 3 of an article and wishesto click back to page 1, the last screen can be clicked twice, retracinghis steps back to page 2 and then to page 1. The user can, therefore,activate the last screen function 26 as many times as needed to retrievean earlier screen. However, those windows that have appeared on aprevious screen cannot be opened by using the Last Screen function 26.To operate this function, the user presses the Last Screen iconwhereupon a display of the last screen will occur at step 480.

Referring now to FIG. 12, a flow chart of the logical operation for theBack function 118 is shown. When the user selects this function, thesystem automatically backs up to the screen where a change in thedecision had previously been made at step 482.

FIG. 13 illustrates the Title Finder entry path 40. The Title Finder 40is activated from the Main Menu (FIG. 1) by clicking the Title Findericon located on the Main Menu display. A title list screen isimmediately displayed at step 500. At this point, the user has a numberof options for searching titles as well as a number of functions he canactivate 501 to assist his search. Those functions include Tools 106,Notes 24, Research Path 25, Last Screen 26 and Main Menu 120. The searchfor titles can be done in three modes. In the first mode, the userenters the title in a box on the display whereupon the Title Findersearches the title list. The decision to enter the title occurs at step502 and the user then types in the title at step 504. The computer thensearches the title list. Whether or not the title is found, the computerwill go to that part of the title list that is the nearest match to thetyped title 506. The user may then go to the article by clicking hismouse on the desired title 508, 510. The second method of searchinginvolves scrolling through the title list 512 by activating up/downarrows 513 until the title of an article is found. The user can then goto the article 514.

The third mode of searching occurs when the user has a subject in mindbut is not sure of the exact title or spelling. He can then click aletter tab shown in the display representing the first letter of thesubject that he wishes to search 516. The computer will then move to thepage of the alphabetical title list 518 for the identified letter. Theuser can then click the up/down arrows until he finds the article hewants, and then retrieves the article at step 519.

FIG. 14 illustrates the Topic Tree entry path 60. As previously noted(see discussion of FIG. 1), Topic Tree 60 is the entry path that dividesall of the articles in the database into topics and sub-topics enablinga user to progressively narrow his/her search through the tree. Inoperation, upon entering Topic Tree 60, a list of topics 522 isdisplayed along with a prompt line of functions. The functions includeTools 106, Notes 24, Research Path 25, Last Screen 26, Back 118 and MainMenu 120. Should the user decide to search through the Topic Tree, hemoves the cursor over the topic of interest and clicks his mouse on atstep 524. A list of sub-topics is then provided at 526.

Sub-topics exist in two forms. If the sub-topics are listed with aninitial capital letter, then that sub-topic covers further sub-topics.Those additional sub-topics are shown on later screens. However, if thesub-topic shown on the list is capitalized, then it directly correspondsto an article. By clicking that sub-topic with a mouse 527, an articleis displayed at 528. Further sub-topics are displayed at step 529 andthe process loops down to further sub-topic levels, at steps 530 and531, until the desired article is uncovered. If the user then decides togo back a level to return to a previous menu screen, he may do so byclicking the Back function 118. Actuating the Main Menu function 120will, in turn, return the user to the Main Menu so that he may chooseanother entry path or exit the multimedia search program altogether.

FIG. 15 is a flow chart showing the Picture Explorer entry path 50. Thepurpose of Picture Explorer is to give the user three ways to findpictures in the database. Once a picture is retrieved that is ofinterest, the user can go directly to an article to learn more aboutthat picture.

To use, upon entering the Picture Explorer menu 50, the user can selectone of several options at step 540. Those options include the threeseparate search paths: picture tour 550, picture finder 570 and picturesearch 590. Additionally, a number of functions are available includingTools 106, Notes 24, Research Path 25, Last Screen 26, Tools 106 andMain Menu 120.

The picture tour search path 550 presents a randomly ordered selectionof pictures from the database. To move forward through the pictures, theuser moves the up/down arrows 552. If the picture appears to be ofinterest, then the user can retrieve an article at steps 553 and 554,display a caption for each picture at steps 555 and 556 or simply movedown to the next picture at step 557. Additionally, the caption can bemoved at steps 558, 559 or the user can return to the picture, to anarticle or to the Main Menu of the Picture Explorer entry path at steps560 and 561.

The picture finder entry path 570 lets the user read through a list ofpicture captions which are grouped alphabetically. The organization ofthe caption list and the method for searching that list, is similar tothe Title Finder entry path algorithm 40 (FIG. 13). In operation, uponentering the Picture Finder 570 a number of functions become availablefor user selection, including Tools 106, Notes 24, Research Path 25,Last Screen 26, Main Menu 120 or Back 118. As in title search, thepicture finder provides three ways of searching for picture captions.The first method 572 involves typing in the picture name 573 whereuponpicture titles closest to that typed in are then displayed 514. If theuser then wishes to learn more about a picture 575, he can activate thecaption 576. The second method involves scrolling up or down through thepicture list at step 579 to review the desired picture 580. The thirdmethod involves clicking a mouse on a letter tab 575 which will thenmove to the page in which the picture titles, starting with the tabletter, appear. The user may then move up and down that page 582 untilhe finds the desired picture caption 583. Step 585 loops back to thefirst decision point for the picture finder search path 570.

Picture search 590 operates in a manner similar to that previouslydescribed with regard to the idea search (See FIGS. 2–5). Generally, thepicture search program 590 operates when a search term describing thepicture caption is entered in the picture search window. For example,should the user want to know how automobile engines work, he types inthe picture search window “how do automobile engines work?” The userthen activates the Go On command (FIG. 2) to tell the computer to beginthe search. When the computer completes its search, search words arere-displayed as highlighted terms. A list of pictures with captions alsois presented and the user can see the picture described by a caption inthe list by clicking the mouse on that caption. The user then calls theassociated article by activating the Go To Article function.

The user also can scroll through the list to see adjacent captions.Captions preceded by at least one asterisk most likely containinformation directly relevant to the search request. The New List or NewSearch functions are also available in this program. These functionsoperate in the same manner described previously for Idea Search.

FIG. 16 is a flowchart of the logical operations of the History Timelineentry path 90. This entry path contains numerous events of historicalsignificance organized along various timelines. When a user clicks amouse on the name of an event appearing on a timeline, a window opensand summarizes that event. Each window includes a list of articles thatrelate to the event. Clicking a mouse on a listed article will take theuser directly to the portion of that article involving that event. TheHistory Timeline is entered by activating an identifying icon in theMain Menu (FIG. 1). As a result, a timeline display 600 is provided.

The timeline display 600 consists of a year bar marked in 5 yearintervals. Each interval is expanded into a separate display. Eachdisplay includes a plurality of major event boxes, event boxes and apresident bar. An era banner is also provided in the display whichgroups dates and historical events into major periods. The president baroperates to open a window that gives the full name and dates thepresident was in office and a list of the major legislation or othersignificant events of that president's administration. Information isordered by the years in which those events occurred. By clicking the GoTo Article function the user can then view a particular article relatingto that event.

When the History Timeline is entered through display 600. That displaywill introduce the entry path and also display the beginning period forthe timeline. The user may then either click the 5 year segment of theyear bar, or click the mouse on an arrow to move the timeline displayahead 12½ years 602, 603. Once the user has reached the desired timelinesegment, he may then choose among several ways to retrieve information.A number of functions including Notes 24, Research Path 25, Last Screen26 and Main Menu 120 are available on all timebar screens.

The first way to retrieve information is by activating a major event box604. Major Events represent historical occurrences consisting of atleast two events. For example, if the user chooses the “Discovery andExploration” major event box, then a window will open 605 listingseveral events that took place during the time period covered by themajor event (between the years 1490–1625). If the user then selects anevent appearing on the list at step 606, i.e., “1492-ChristopherColumbus discovers the New World”, another window opens containing adescription of that event at step 607. The user may click the mouse onthe up/down arrows to read more about the event.

If the user then wishes to see articles relating to that event 608, hethen activates the Go On command 609. A window with a list of articletitles is then set forth. The user can then call a related article e.g.“Columbus” by clicking the mouse over the listed title 610 as previouslydescribed. When in reviewing the article, the user is ready to return tothe History Timeline 90, he activates an icon representing the timeline.

A second search option in History Timeline 90 is the event box 616. Theevent box operates in a similar manner to the major event box, exceptthat it only represents one event. Accordingly, when clicking a mouse onthe event box, a window opens 617 displaying information about theevent. Often included in the event window 617 is an audio feature 618which is played by clicking an audio icon 619. Articles can then beselected in steps 620–622 in the same manner as for major events. Theoption for moving the next display screen by the arrow icons is shown insteps 625–627.

Turning now to FIG. 17, the third method of searching the HistoryTimeline 90 is shown. This third method involves activating thepresident's bar 628. To use, a user clicks on a display box containing apresident's name. A display listing significant events during thatpresident's administration 629 is then shown. If the user wishes to seea related article 630, he clicks the Go To Article command 632 whichcauses a display of the article at step 633. To exit from the articleand return to the History Timeline icon, the user must then activate anappropriate icon appearing in the prompt line.

FIG. 18 is a flow chart showing the logical operations of the WorldAtlas entry path 80. The purpose of this entry path is to allow a userto see and use maps of the earth. The user can specify a place he wantsto see, then the computer can draw a corresponding map. To find out moreabout places shown on the map, the user can then retrieve articlesrelating to a desired part of the map.

The World Atlas program is entered by clicking the World Atlas icon inthe Main Menu (FIG. 1). Immediately upon entering World Atlas, an atlasis displayed at step 650. There are seven levels from which the user candisplay a map from the atlas. Each level corresponds to the scale of theatlas. When the user first enters World Atlas, he will see a map of theWestern Hemisphere drawn at level 1. The user may then choose to rotate,zoom-in, or zoom-out of each level. By moving a cursor on the Atlas, thecenter of the Atlas may be moved to correspond to the cursor's position.The user also rotates the globe by clicking the mouse on a compassdirection icon at step 652 which will cause the atlas to pan in thedirection of the compass 653.

A further feature of the World Atlas entry path is the labels function654. Labels operates as follows: when the user turns Labels on 655,place name labels are written onto the atlas. If the user is interestedin seeing an article that is related to a place name label 656, he canclick the cursor over the label 657 which will then display a list ofarticles related to the place name 658. If an article of interestappears in the list 659 (FIG. 19), the user can then select that article660. The user returns from the article to the timeline by pressing atimeline icon, as previously described.

Another viewing function for the World Atlas entry path is the zoom-inand zoom-out feature. As previously mentioned, there are seven levelsfrom which the earth can be viewed. If the zoom-in is initiated 662, theuser can focus on one or more levels to see a closer view of that areaof the map 665. The map can be zoomed-in all the way at steps 666 and667 to level 7. When the lowest level is reached, the zoom-in clickspotdisappears and the user can only zoom-out.

When the maps are displayed at levels 3 and 7, a mileage scale appearson the lower right corner of the screen. Mileage scales are not givenfor levels 1 and 2 because these levels give two global views of theearth. In other words, measuring distances between two points on theglobe must take into account the curvature of the earth. Mileage scalesare most useful when distances can thus be represented as straightlines. At levels 3 through 7, therefore, distances between two pointscan be measured by a straight line. A further viewing function for theAtlas is the latitude-longitude option 670. By clicking on thelatitude-longitude function, the computer adds lines 672 to the Atlasindicating latitude and longitude markings. This will thus give the usera better idea of the location of various places on the map.

Step 674 relates to the Place Finder search path. This feature enables auser to search the globe in three ways: (1) by clicking a mouse on theup/down arrow and moving through an alphabetical list of places, (2) byclicking a letter tab that appears along the side of the list of places,or (3) by typing in the first few letters of a place that the user wantsto see. Once the place is found on the list, by any of the abovemethods, the user then clicks the mouse on that place entry, and thatentry will be immediately displayed on the globe. Operations of theplace finder program are shown in more detail in FIG. 20. Specifically,the place name list is first displayed upon activating the place findericon 676. The user is then provided with a selection of functionsincluding Tools 106, Notes 24, Research Path 25, Last Screen 26 and MainMenu 120. In addition to these functions, the user may search the placename list at step 678.

If the user decides to search the place name list 678 by name 680, hemust first type in the name in the place box 682. A search by thecomputer of the list of names 684 then occurs. If the user then clicksthe mouse on the place name 686 on the list, a map having the placeidentified at its center is shown 688. Activating the up/down icons 690or selecting a letter tab corresponding to the first letter of the placename list 692 and 694 also will turn up place names for the list.

Returning to FIG. 18, the Atlas also may be rotated by moving the mouseto a new place on the Atlas 700 and then clicking on the mouse 702. As aresult, the Atlas will be redisplayed with the cursor positioned as it'scenter.

The World Atlas entry path 80 can be used to approximate the latitudeand longitude of many places. For example, whenever a map is on thescreen, the coordinates of the latitude and longitude of that point inthe center of the screen appear across the top of the screen. Referencecoordinates are available whether or not the latitude and longitudelines appear on the map. Moreover, when the place name search path isused in conjunction with the latitude and longitude functions, the exactcoordinates of that place are thereby made available. However, if aplace that does not have a discrete location is searched (e.g., river,region) then the computer draws a map around the center-point of thescreen region or area displayed.

For example, suppose the user accesses the place name search path todraw a map of Shanghai, China. A circle representing the geographiclocation of Shanghai then appears at the center of the screen and thehighlighted word “Shanghai” is displayed next to it. The latitude andlongitude of the city (31N 121E) also appear on the display. If the userthen clicks the mouse on the “Lat/Long On” icon at step 670, thecomputer will add lines for the latitude and longitude. This will thengive the user a better idea of the location of various places on themap.

Alternatively, if the user decides to see a map of “Korea”, the computerwill then re-draw the map so that Korea is at the center of the screen.The latitude and longitude reading in the title line (36N 127E) therebyrepresents the coordinates of the approximate center of the country ofKorea.

Another feature of the World Atlas entry path, is that when a map isdrawn, the arrow cursor remains in the prompt line and cannot be movedup into the map area. Only after a map has been completely drawn, shadedand labelled (if labels are turned on), can the cursor be moved onto themap.

All cities that appear on the map have a circle next to their labels. Acircle indicates the geographic location of the city. Cities that arecapitals of countries are marked with a star surrounded by a circle.Cities that are capitals of states have a star located next to theirlabels. When the place finder is used, the place label will behighlighted on the map that is drawn, and a symbol will be located atthe center of the screen.

FIG. 21 illustrates the logical operations of the Researcher's Assistantentry path 70. The purpose of the Researchers Assistant is to set-upresearch questions for users. Researcher's Assistant contains numerousarticles divided into several categories. Each particular categoryconsists of topics containing three assignments. The assignments aremarked according to their level of difficulty for the user. To use theResearcher's Assistant 100, a display 720 is provided to the user whichallows him to select from one of several available topic categories. Anumber of other options are available on the display's prompt lineincluding Notes 24, Research Path 25, Last Screen 26, Tools 106 and theMain Menu 120.

If a research category is selected 722 from display 720, then a list ofresearch topics appears 724. The user may then select the researchassignment after reviewing the displayed description of the topic 728.The selection step 729 involves three levels of difficulty 730, 732 and734. An assignment is selected by clicking a mouse on the chosenassignment. The user may then review information about the topic andabout the assignment. Once the user makes a decision about whichassignment to work on, he can then cut and paste that assignment intohis Notes 24 and then return to the Main Menu through function 120. Inthe Main Menu, the user can then choose an appropriate entry path forthat assignment. The other options include the ability to go back andview the last screen 26, to go to another program from the Research Pathlist 25, to go back to the last decision step through the Back function118 or to employ Tools 106.

For example, if the user is interested in doing research on “spiders” hethen selects “Living Things” from the research categories at step 720.The term “spider” would then be selected from the topic list at step726. The user would then read the screens of introductory text for thattopic and move through those screens using the down arrow at step 728.At the end of the topic, three assignments would be available:

Make That Four Pairs of Shoes Please

Spiders Have Feelings Too

Beautiful But Deadly

To make a selection 729, the user clicks the name of the assignment 730,732 and 734 so that the information on the assignment will then bedisplayed. That information includes the name of articles where the userwill find the information for that assignment.

Should a different assignment on the same topic be desired, the Backfunction 118 returns the user to the screen where the three assignments730, 732 and 734 are listed. Should the user want to then select adifferent topic from the same category, the Back function 118 isactivated again, returning to the topic menu 724. Clicking Back 118 oncemore, returns to the menu of research categories where the user canselect a new category of topics.

Any time the user is looking at the introductory text for a topic, theuser can click the next topic function 736 which will move them ahead738 to the next topic in the same category without having to return tothe topic menu 740. To change a research category, however, the Backfunction 118 must be employed as described above.

Once the user has determined which assignment he wants to search byclicking the Main Menu 120, the user is then prompted by the displayabout whether or not he wishes to save that assignment stored in hisnotes 24. If the answer is “no”, the user will return to the Main Menuat step 744.

As an alternative, the Researcher's Assistant path can be designed to beplayed as a game. The goal of the game is to encourage users to competein obtaining information from the database. The game is arranged as acompetitive scavenger hunt. Each user is asked to collect informationabout a question and is encouraged to collect facts and store thecollected facts in a single storage area. The user then is scored on thetime it takes him to retrieve facts and the number of correct facts hecollected. The game is played at different levels of difficulty.

FIG. 22 illustrates the Feature Articles entry path 70. This entry pathtakes the user directly to a number of the most interesting articles inthe database. All articles have been enhanced with additional text,sound and pictures. In use, when the user clicks on the entry path icon,a display of the feature categories for Feature Articles are presented750. The user then selects an article 752 by moving a cursor over one ofthe titles shown on the display screen 750 and by clicking the mouse. Asa result, the display will show page one of the article 754 that isselected. The user then goes to the article display which includes onits prompt line the Feature Articles 756. By clicking the icon on atstep 758, the user will return to the Feature Articles menu 70. Otherfunctions available in the Feature Articles entry path 70 are Notes 24,Research Path 25, Last Screen 26, Back 118 and Main Menu 120.

While a particular embodiment of the present invention has beendisclosed, it is to be understood that various different modificationsare possible and are contemplated as being within the true spirit andscope of the claims. There is no intention, therefore, of limiting thisinvention to the exact abstract or disclosure presented herein. Moreparticularly, it is contemplated that this invention can be used withany information that can be stored in a database. While the presentinvention has largely been described with reference to an encyclopaedia,other databases of published graphical or textual information could beincluded.

1. A search and retrieval system having textual and image data stored ona computer-readable recording medium, comprising: links between textualdata and image data so as to form interrelationships between the textualdata and image data; an image entry path for retrieving image data andalso textual data that is interrelated with the retrieved image data;and a textual search entry path for searching textual data and forretrieving textual data and also a plurality of image data that isinterrelated with the retrieved textual data; said image entry path andsaid textual search entry path are independently accessible andseparately and independently searchable entry paths for retrieving saidtextual and image data.
 2. The system according to claim 1, wherein saidtextual data comprises words, phrases, numbers and letters.
 3. Thesystem according to claim 2, wherein said textual search entry pathfurther comprises ranking means for ordering said textual data in orderof relevance to said search inquiry.
 4. The system according to claim 1,wherein first image data and first textual data are interrelated, saidimage entry path retrieves said first image data and also saidinterrelated first textual data, said textual search entry path searchesfor said first textual data and retrieves said first textual data andalso said interrelated first image data, and said image data includingpicture data.
 5. A machine-implemented search and retrieval systemincluding a processor, a display and storage, said system comprising: animage entry path for retrieving image data, said retrieved image databeing displayed along with at least one icon to access textual data thatis linked with the retrieved image data; and a textual search entry pathfor searching textual data and for retrieving textual data, saidretrieved textual data being displayed along with at least one icon toaccess a plurality of image data that is linked with the retrievedtextual data; said image entry path and said textual search entry pathare independently accessible and separately and independently usableentry paths for retrieving said textual and image data.
 6. The systemaccording to claim 5, wherein said textual data comprises words,phrases, numbers and letters.
 7. The system according to claim 5,wherein said textual search entry path comprises idea entry path meanshaving a searching means for searching said textual data for terms andphrases that closely resemble a search inquiry.
 8. The system accordingto claim 7, wherein said textual search entry path further comprisesranking means for ordering said textual data in order of relevance tosaid search inquiry.
 9. A machine-implemented screen display with aninterface to access a search and retrieval system comprising: a mainmenu for accessing an image entry path and for accessing a textualsearch entry path, wherein said image entry path retrieves image data,said retrieved image data being displayed on said screen display alongwith an indicator to access textual data that is associated with theretrieved image data; and wherein said textual search entry pathsearches and retrieves textual data, said retrieved textual data beingdisplayed on the screen display along with indicating means to access aplurality of image data that is associated with the retrieved textualdata; said search and retrieval system including a bookmark interfaceitem to store for access by a user a pointer to textual data that isassociated with the retrieved image data.
 10. The system of claim 9,wherein said navigation interface items include a back interface item toaccess a previous screen of textual data that is associated with imagedata.
 11. The system of claim 9, further comprising cut and pasteinterface items for cutting textual data retrieved by the textual searchentry path so that the cut textual data may be pasted into a document.12. The system according to claim 9, wherein said image entry path andsaid textual search entry path being independently accessible andseparately and independently usable entry paths for retrieving saidtextual and image data.
 13. The system according to claim 9, whereinsaid textual data comprises words, phrases, numbers and letters.
 14. Thesystem according to claim 9, wherein said textual data retrieved by thetextual search entry path is displayed on the screen display along withindicating means to access a form of multimedia content, wherein saidmultimedia content comprises photographs, graphics, audio, video, andanimations.
 15. The system according to claim 9, wherein said indicatingmeans comprises an icon.
 16. A machine-implemented user interface forsearching and retrieving multimedia information through a processor,comprising: a plurality of search entry paths for searching themultimedia information, the plurality of search entry paths including atextual search entry path and a picture search entry path; wherein thetextual search entry path receives inputted search terms and retrieves alist of articles that correspond to the search terms, wherein the listof articles are ordered by relevance to the search terms; wherein thepicture search entry path receives inputted search terms and retrieves alist of a plurality of pictures that correspond to the search terms,wherein the list of pictures are ordered by relevance to the searchterms; a selecting device for selecting one of the articles from thelist of articles or for selecting one of the pictures from the list ofpictures, wherein the user interface displays the selected article orpicture; and a multimedia indicator associated with the displayedarticle or the displayed picture, wherein the multimedia indicatoraccesses an associated picture when selected from the displayed articleor an associated article when selected from the displayed picture. 17.The interface according to claim 16, wherein said textual search entrypath further comprises ranking means for ordering said list of articlesin order of relevance to said search terms.
 18. The interface accordingto claim 16, wherein said multimedia information comprises photographs,graphics, audio, video, and animations.
 19. The interface according toclaim 16, wherein said multimedia indicator is an icon.
 20. Amachine-implemented user interface including a processor for searchingand retrieving multimedia information comprising: a plurality of searchentry paths for searching the multimedia information, the plurality ofsearch entry paths including a textual search entry path and a textualbrowse entry path, the textual search entry path receiving search termsinput by a user and retrieving a list of articles that correspond to thesearch terms, wherein the user selects an article from the list ofarticles, which is then displayed by the user interface; the textualbrowse entry path displaying a hierarchy of topics and sub-topics, whichare browsed by the user until a particular article title is displayed,wherein the user selects the particular article title in order todisplay the selected article; a plurality of multimedia indicatorsassociated with the displayed articles, wherein at least one of thearticles includes a plurality of associated multimedia indicators, theplurality of multimedia indicators including a picture indicator thatindicates a picture is associated with the article and is available fordisplay, said multimedia indicators further including a video indicatorthat indicates a video is associated with the same article and isavailable for display.
 21. The interface according to claim 20, whereinsaid textual data comprises words, phrases, numbers and letters.
 22. Theinterface according to claim 20, wherein said textual search entry pathcomprises idea entry path means having a searching means for searchingsaid textual data for terms and phrases that closely resemble a searchinquiry.
 23. The interface according to claim 20, wherein saidmultimedia information comprises photographs, graphics, audio, video,and animations.
 24. The interface according to claim 20, wherein saidmultimedia indicators are icons.
 25. A machine-implemented multimediaresearch system comprising: a search and retrieval interface providing aplurality of search entry paths for researching multimedia information,the multimedia information including text articles having indicatorsthat associate the text articles with a plurality of related pictures,videos or sounds that can be accessed through the search and retrievalinterface; wherein the plurality of search entry paths include a textualsearch entry path for inputting textual search terms and for providing asearch result indicating text articles corresponding to the searchterms, and a textual browse entry path for browsing a hierarchy oftopics and sub-topics and for providing a search result indicating textarticles associated with a browsed sub-topic; and a bookmark functionfor marking the search results provided by the plurality of search entrypaths and for storing a plurality of associated bookmarks, wherein thebookmarks may be activated to display the marked search results withoutaccessing the plurality of search entry paths.
 26. The system accordingto claim 25, wherein said text articles comprise words, phrases, numbersand letters.
 27. The system according to claim 25, wherein saidmultimedia information comprises photographs, graphics, audio, video,and animations.
 28. The system according to claim 25, wherein saidindicators are icons.
 29. A multimedia search and retrieval methodcomprising the steps of: (A) inputting one or more textual search termsinto a search and retrieval interface and displaying a list of articlesthat correspond to the search terms, wherein the list of articles areordered by relevance; (B) selecting one of the articles in the list ofarticles and displaying the article, wherein the displayed articleincludes a plurality of multimedia indicators that associated thearticle to pictures, videos or audio clips; (C) if one of the pluralityof multimedia indicators refers to a picture, then selecting themultimedia indicator and displaying the picture; (D) if one of theplurality of multimedia indicators refers to a video, then selecting themultimedia indicator and playing the video; (E) if one of the pluralityof multimedia indicators refers to an audio clip, then selecting themultimedia indicator and playing the audio clip; (F) After one of steps(C), (D) or (E) activating a back function to return to a display of theselected article.
 30. The method according to claim 29, wherein saidarticles comprise words, phrases, numbers and letters.
 31. The methodaccording to claim 29, wherein said multimedia indicators are icons.